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Abstract 


The Held-Karp heuristic for the Traveling Salesman Problem (TSP) has in prac- 
tice provided near-optimal lower bounds on the cost of solutions to the TSP. We 
analyze the structure of Held-Karp solutions in order to shed light on their quality. 
In the symmetric case with triangle inequality, we show that a class of instances has 
planar solutions. We also show that Held-Karp solutions have a certain monotonicity 
property. This leads to an alternate proof of a result of Wolsey, which shows that 
the value of Held-Karp heuristic is always at least 20PT, where OPT is the cost 
of the optimum TSP tour. Additionally, we show that the value of the Held-Karp 
heuristic is equal to that of the linear relaxation of the biconnected-graph problem 
when edge costs are non-negative. 

In the asymmetric case with triangle inequality, we show that there are many 
equivalent definitions of the Held-Karp heuristic, which include finding optimally 
weighted 1-arborescences, l1-antiarborescences, asymmetric 1-trees, and assignment 
problems. We prove that monotonicity holds in the asymmetric case as well. These 
theorems imply that the value of the Held-Karp heuristic is no less than Tognt OPT 
and no less than the value of the Balas-Christofides heuristic for the asymmetric 
TSP. 

For the 1,2- TSP, we show that the Held-Karp heuristic cannot do any better than 
OPT, even as the number of nodes tends to infinity. 

Portions of this thesis are joint work with David Shmoys. 
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Chapter 1 


Introduction 


1.1 General Background 


The Traveling Salesman Problem (TSP) is one of the most notorious in the field of 
combinatorial optimization, and one of the most well-studied [24]. As with many 
other famous open questions in mathematics, such as Fermat’s Last Theorem, the 
question is quite easy to state, but its solution has evaded researchers. The problem 
is this: given the costs associated with traveling between any pair of n cities, find 
the least-cost tour that visits each city exactly once. In other words, suppose we 
have costs ¢;;, 1 < 2,7 <n, associated with traveling from city 7 to city 7. To solve 
a particular instance of the problem (that is, to solve the problem for a particular n 
and a particular set of c;;), we must find a cyclic permutation a, such that 


nm nr 


Do Cion(s) = min) Cirn(i)- 
1 : t=1 


i=1 

The open question posed by the Traveling Salesman Problem differs from that 
posed by Fermat’s Last Theorem, however, in that it involves determining the exis- 
tence of an algorithm for the TSP whose running time is bounded by a polynomial 
inn. A polynomial-time algorithm for the TSP would be able to determine a, for all 
possible instances. Proving the existence of such an algorithm (either constructively 
or non-constructively) would be similar to proving that a decision version of the TSP 
is in P, the class of all polynomial-time solvable decision problems. The decision ver- 
sion of the TSP includes an extra number B in the input and outputs “yes” if and 


only if the cost of the minimum tour is no greater than B. If a polynomial-time algo- 
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rithm for the TSP exists, then certainly a polynomial-time algorithm for the decision 
version of the TSP exists. It is also not too hard to see that the converse is true (see 
[20], pp. 46-48). Thus a polynomial-time algorithm for the TSP exists if and only 
if the TSP decision problem is in P. This does not seem very likely, however, since 
the TSP decision problem is A’P-complete [22]. A’P-completeness implies that if the 
TSP decision problem is in P, then P = NP. Whether or not P = NP is unknown, 
but it is generally believed that P 4 NP. 

Nevertheless, work has continued on the TSP through attempts to find polynomial- 
time approzimation algorithms [21]. The most natural way to approximate the TSP 
is to devise an algorithm that explicitly constructs a tour which is not necessarily 
the minimum-cost tour. Such an algorithm may have a guarantee that the tour it 
constructs has cost no greater than a times the cost of the optimum tour (OPT), for 
some a > 1. Another way to approximate the TSP is to find a value that estimates 
the cost of the optimal tour. There are several ways to find such a value. One way 
is to construct an optimal relared tour. If we think of a tour as a combinatorial 
object with certain properties (e.g., a graph with n edges, connected, each node with 
degree two, and so on), then a relaxed tour is a combinatorial object with a subset of 
those properties, so that all tours are also relaxed tours. For example, an assignment 
is a relaxed tour since it is a graph with n edges such that each node has degree 
two. Clearly a minimum-cost relaxed tour can have cost no greater than OPT. A 
relaxed-tour approximation algorithm may also have a guarantee that the value it 
produces is no less than 7 times OPT, y < 1. Thus by finding optimal relaxed tours 
in polynomial time, we can approximate the value of the optimal tour without explic- 
itly constructing a tour. We will call an approximation algorithm non-constructive 
if it does not construct a tour in its approximation of OPT. From here on, we will 
say that an approximation algorithm has a guarantee of a if a > 1 and the value it 
returns is between OPT and aOPT, and that it has a guarantee of 7 if y < 1 and the 


value it returns is between yYOPT and OPT. We can transform an @ approximation 


1 


algorithm into a y = = 


approximation algorithm simply by multiplying the value of 
the a algorithm by i. Therefore, an a approximation algorithm will be said to be 
“as good as” ay = 4 approximation algorithm. 


Unfortunately, Sahni & Gonzalez [32] have shown that no TSP approximation 
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algorithms exist with constant guarantees unless P = NP. Thus research in ap- 
proximation algorithms for the TSP has concentrated on several special cases of the 
TSP, each of which is MV P-complete in its own right. These special cases include 
the symmetric TSP with triangle inequality, the asymmetric TSP with triangle in- 
equality, and the symmetric 1,2-TSP. A TSP instance is said to be symmetric if 
ci; = cj; for all 7,7, and asymmetric if this is not necessarily the case. An instance 
obeys the triangle inequality if c;; < ci, + ¢,; for all distinct i,j,k, and an instance 
is a case of the 1,2-TSP if for all i,7 either c;; = 1 or qj = 2. The best known 
tour-constructing approximation algorithms for these three cases have guarantees of 
a = 2 [3], a = flogn] [11], and a = Z [30] respectively. Not as much work has 
been done on finding non-constructive approximation algorithms with good guaran- 
tees. Nevetheless, in the symmetric case with triangle inequality, it is well known 
that finding a minimum-cost spanning tree gives an y = 4 guarantee. In addition, 
several non-constructive heuristics seem to do very well in practice [17], [1], [2]. In 
particular, a “lower bound” heuristic developed by Held and Karp typically delivers 
solutions of cost above 99% of OPT for the symmetric case with triangle inequality 
[4], [37]. 


1.2 The Held-Karp Heuristic 


Held and Karp proposed trying to find a minimum-cost tour in the symmetric case 
by trying to find an optimally weighted 1-tree [17]. A 1-tree of a graph G = (V, E) 
with V = {1,...,n} is a spanning tree on nodes {2,...,n} plus two edges incident 
to node 1. Thus a 1-tree has exactly one cycle, which contains node 1, and node 1 
always has degree two. Note that a 1-tree is a relaxed tour. A minimum-cost 1-tree 
can be obtained by finding a minimum-cost spanning tree on {2,...,n} and adding 
the two lowest cost edges incident to node 1. If 7 = (m1,...,7,) is a real n-vector, 
then the minimum-cost 1-tree with respect to 7 is defined to be the minimum-cost 
1-tree with respect to the reduced costs ¢;; = cj; +7: +7;. If T;, is the minimum-cost 


1-tree with respect to 7, we define w(7) such that 


w(r) _ >» Gj — 2) mi 


(2,9)€T, 
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The value produced by the Held-Karp heuristic is max, w(7). In other words, the 
Held-Karp heuristic finds the vector a such that the value of the minimum-cost 1-tree 
is the greatest. 

Intuitively, the heuristic tries to find the m vector such that the 1-tree is as close 
as possible to being a tour, without exceeding the cost of the optimal tour. Suppose 
that the minimum-cost 1-tree with respect to has a node u with degree greater 
than 2. Then it seems that we should be able to find a x’ such that w(z’) > w(r) 
simply by increasing the value of 7,,, since this will increase the (ig) eT Gj part of 
w(t) by more than the —257°"_, 7; part will decrease. Likewise, if wu has degree 1, 
then we should be able to find a a 7’ such that w(z’) > w() by decreasing the value 
of ,. Thus by finding max, w(7), the heuristic tries to force the degree of all nodes 


to be 2. Now suppose J; is the minimum-cost tour. Then 


w(t) = > %j - 230m; 
1 


(1,9)ET. i= 
< Sc tj —2 s; Ty 
(tj) ET i=1 
n 
= DO (cy tmtaj)-250 5: 
(i,j) ET i=1 
= ys Cij. 
(2,9) ET: 


So certainly max, w(m) is no greater than the cost of the optimal tour, 7 (; ;)e7, Cij- 


Held and Karp proved the following theorem about their heuristic. 


Theorem 1.2.1 (Held, Karp [17]) The Held-Karp heuristic produces exactly the 


same value as the following linear program’ : 


"In fact, Held and Karp consider a linear program with the subtour elimination constraints (that 
is, constraints ) > zi; < |S|—1) only for those subsets not containing node 1. However, it is easy to see 
that the additional constraints are implied by the corresponding constraint on the complementary 
set of nodes. 
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minimize > C7tG (1.1) 
1<i<j<n 
subject to: = Yi nist Dia = 2, i=1,2,...,n, 
j>i j<i 
B zizj < |[S|-1, for any proper subset SCV, 
IES, JES I< 
tii Sl 1<i<jcn, 
tii 2 0 Lays Sn, 


This linear program produces a relaxed tour, where variable 2;; denotes the 
amount of edge (i,j) in the solution. Note that if the z,;; variables were guaranteed 
to be either 0 or 1, the relaxed tour would be an actual tour, and the linear program 
would solve the TSP exactly. Linear program (1.1) is sometimes called the linear 
relaxation of the TSP. ? We will refer to (1.1) as the Subtour LP. 

The formulation of the heuristic as a search for an optimally weighted 1-tree can 
be thought of as an instance of Lagrangean relaration. In Lagrangean relaxation, 
some constraints of a linear program are dropped, but penalties for their violation 
are added to the objective function. In the case of the Subtour LP, the constraints 
forcing the degree of each node to be 2 are dropped but the m vector acts as a penalty 
for violating the node degree constraints. The m; are sometimes called Lagrangean 
multipliers. 

There are other equivalent formulations of the Held-Karp heuristic. In their 
original paper, Held and Karp noted that max, w(m) can be expressed as a linear 
program. Let 7,,72,...,7; be an enumeration of all 1-trees. It will be convenient to 
let cx be the cost of 1-tree T;, dj, be the degree of node 7 in Ty, and vj, = dj, — 2. 
So then 


n 
w(1r) = min[ck + » T; Vik]. 
Thus we can express max, w(7) as 


Interestingly enough, (1.1) was the basis of one of the earliest attempts to grapple with the TSP. 
Dantzig, Fulkerson, and Johnson [5] started with the node degree constraints )~ z;; = 2 and added 
subtour elimination constraints as necessary. 
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maximize w 


1.2 
subject to: wi < cet 024 miviz, Vk = 1,...,t. (1.2) 
t=1 


The dual of this linear program will also be an equivalent formulation of the heuristic. 
Taking the dual of (1.2) yields 


minimize eK KY 
subject to: Deve = |, (1.3) 
ee Vikyk = O t=1,...,2, 
a 


Held and Karp noted that the LP above finds the minimum-cost convex combination 
of 1-trees such that the average degree of each node is 2. Finally, it has been shown 
that the subtour elimination constraints of the Subtour LP can be replaced with 
constraints of the form 
> 23> 2 VEC V. 
ijES <j 

This replacement of constraints yields an LP that is another equivalent formulation 
of the Held-Karp heuristic. 

Held and Karp proposed several algorithms for finding the optimally weighted 
1-tree [17], [18]. Their most successful approach involves use of a technique known 
as subgradient optimization. Given a concave function f, a vector s is said to be 
the subgradient of f at @ if for all u, f(@) +s-(u—%) > f(u). It turns out that 
for sufficiently small A, 7+ As is closer than @ to the point at which f reaches its 
maximum value. Let vg, = (dix —2, do, —2,...,dnx—2), where dj, is the degree of the 
ith node of the minimum-cost 1-tree with respect to 7, T;,. Held and Karp showed 
that v, is a subgradient for the function w(a). They then proposed generating a 
sequence of m vectors (x!,7?,...) according to the rule 

gmtl — 7M 4 ym Gere a) Ves 
Ilv« ||? 
where 0 < A™ < 2 and W is some “target value” such that w(m) < @ < max; w(7). 
Notice that this update rule is a formalization of the intuition above of increasing 7; 


when d;, > 2 and decreasing 7; when dj, < 2. Held and Karp showed that if A” > € 


3See Lemma 8 of [16] 
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for some € > 0 for all m, then the sequence of 7” either converges to or contains 
some z! such that w(x!) > @. 

No one has yet bounded the number of iterations of subgradient optimization to 
guarantee a polynomial running time. The ellipsoid method of linear programming 
can be used on the LP formulation, since max-flow programs can be used to find 
violated constraints or verify the feasability of solutions. Thus the ellipsoid method 
can find the solution to the Subtour LP in polynomial time [23], [15]. In fact, the 
solution can be found in strongly polynomial time due to a result of Frank and Tardos 
[9]. However, both of these algorithms are considered to be more of theoretical 
interest rather than practical interest. No practical algorithms are known for the 
Held-Karp heuristic that are guaranteed to run in polynomial time. 

The Held-Karp heuristic has proven interesting for a number of reasons. The 
first reason, as mentioned above, is its astonishing accuracy in practice. Johnson 
[19], who uses the heuristic to evaluate the performance of various tour-constructing 
algorithms, estimates that the Held-Karp heuristic usually comes within 99.5% of 
the cost of the optimal solution. The second reason is that the heuristic is used 
as the basis for still more sophisticated heuristics for the TSP. Several researchers 
have used it within branch and bound schemes (see [2]). Grétschel and Padberg use 
the Subtour LP as the basic linear program within their cutting plane approach to 
solving the TSP [28). 

The reasons for the near-optimality of the heuristic’s solutions have not been well 
understood. This thesis investigates the structure of solutions found by the Held- 
Karp heuristic in order to shed light on their accuracy. We consider the symmetric 
case with triangle inequality, the asymmetric case with triangle inequality, and the 
1,2-TSP in Chapters 2, 3, and 4 respectively. 

In the chapter on the symmetric case, we show that instances from two-dimensional 
Euclidean space have planar solutions. We also show that symmetric instances with 
the triangle inequality have a certain monotonicity property: namely, given a graph 
G' induced by removing a node of a graph G, the value obtained by the heuristic 
on G’ is not greater than the value for G. With one additional lemma, we give an 
alternate proof of a theorem of Wolsey [39] which shows that the Held-Karp heuristic 


has ay = 2 guarantee for these instances. We explore connections between Held- 
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Karp solutions and solutions to another NP-complete problem, the minimum-cost 
biconnected-graph problem. Finally, we conjecture that the Held-Karp heuristic has 
a guarantee of y = 3 and we provide an example which meets this lower bound. 

For the asymmetric case, we consider the extension of the heuristic to the asym- 
metric case proposed by Held and Karp in terms of weighted 1-arborescences. We 
show, using a powerful theorem of Geoffrion [12], that the heuristic can also be 
viewed in terms of weighted 1-antiarborescences, assignment problems, and asym- 
metric 1-trees. We deduce as a corollary that the Held-Karp heuristic has a bound 
that dominates the bound of another non-constructive lower-bound heuristic for the 
asymmetric TSP due to Balas and Christofides [1]. We give the analagous monotonic- 
ity proof for the asymmetric case with triangle inequality and show how this implies 
an Y = Teenl guarantee, matching the best known a = [logn] tour-constructing 
guarantee. 

Finally, for the 1,2-TSP case, we show that the heuristic cannot do better than 
y= ‘ue even as n tends to infinity. We again investigate connections between Held- 


Karp solutions, the minimum-cost biconnected graph, and the TSP. 


Chapter 2 


The Symmetric Case with 
Triangle Inequality 


Recall from the previous chapter that a TSP instance is symmetric if ¢;; = ¢;; for all 
i,j, and obeys the triangle inequality if cj, +x; > cj; for all i,7,k where i, 7, and k 
are distinct. The symmetric case of the TSP with the triangle inequality is perhaps 
the most-studied special case of the TSP. It contains the subcase of finding tours 
through points in the plane, where c,; is the Euclidean distance between points i and 
j, since the Euclidean metric is symmetric and obeys the triangle inequality. We will 
call this subcase the Euclidean TSP. One of the earliest papers on solving the TSP 
dealt with the Euclidean TSP, finding a tour through cities of the 48 continental 
states of the U.S. [5]. The Euclidean TSP is NP-complete [29]. 


2.1 Planarity of Solutions 


We begin this chapter by showing that for any instance of the TSP! which has 
an embedding of its nodes in the plane that obeys certain properties, the Held-Karp 
heuristic has an optimal solution that is planar. We will then show that the Euclidean 
TSP with the straightforward “Euclidean embedding” always has a planar solution. 
First we need to define what we mean by an embedding and what it means for a 
Held-Karp solution to be planar. An embedding is a one-to-one mapping from the 


nodes of the instance to points in the plane. The embedding corresponds a distinct 


"We will assume for the rest of this chapter that any TSP instance referred to is symmetric and 
obeys the triangle inequality. 
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point p; € R? with each node 7. An embedding does not require the topological 
distance between p; and p; to be the same as the distance c;; between nodes 7 and j. 
Let & be the optimal solution to the Subtour LP on n nodes, let V = {1,...,n}, and 
let Epp = {(i,j)|Tij > 0}. We say F is planar if and only if the graph G = (V, ELp) 
is planar. We will show planarity by concentrating on a particular embedding of 
nodes in the plane. If G is planar, then it will have a plane representation for that 
particular embedding of nodes [26]. All that remains to be proved is that given an 
embedding, G has a plane representation, and thus is planar. We will now show that 
any instance of the TSP has a planar Held-Karp solution if there exists an embedding 
that meets two conditions. The first condition is that no three of the points of the 
embedding are colinear. The second condition is that the edge costs obey a property 


called the bor property. 


Property 2.1.1 (Box Property) Consider an embedding of the nodes 1,...,n of 
a TSP instance into the plane at points py,..., Dy respectively. Pick any four distinct 
nodes i,j,k,l such that the line segments (p;,p;), (Pj,Pk), (Pe, Pi), and (pj, pi) define 
a conver quadrilateral. The embedding of the TSP instance is said to have the box 


property if for any such i,j,k,l, cij + ck < cig + cj) and cj + CjK < Cik + Cj1- 


In other words, an embedding has the box property if for any four points defining 
a convex quadrilateral, the sum of the edge costs of opposing sides of the quadrilateral 
is less than the sum of the diagonals. 

We will now show that given an embedding of an instance with the box property 
and with no three points colinear, there is an optimal solution to the Subtour LP 
that is planar. To do this, we will first show that we can use the formulation of the 
Held-Karp heuristic as a convex combination of 1-trees instead of the Subtour LP 
formulation. Then we will show that if we draw straight line segments between p; 
and p; for every edge (2, 7) in the convex-combination solution, intersecting segments 
imply that the solution is not optimal. 

As was noted in Chapter 1, the following linear program is an equivalent formu- 


lation of the Held-Karp heuristic: 
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minimize YE CRY> 
subject to: Yeve = 1, ; (2.1) 
Verkyk = O t= 1,...,2, 
ye 2 0. 


If y is the optimal solution to this linear program, let Ecc = {(1,7)|4k with (7,7) € 
T;, and y, > 0}. We will show that Eco = Eyp so we can use the edge set Ecc 
when drawing lines in the plane. 
Lemma 2.1.2 Eco = Epp for some optimal solution & to the Subtour LP. 
Proof: Let y be a feasible solution to (2.1). Set 
t= 5 We 

{k\(i,3 ET} 

We will show that F is a feasible solution of the same cost for the Subtour LP. Since 
the Subtour LP and LP (2.1) both give the same value, if y is optimal, then 7 will 
be also. The constraint 7; < 1 follows from >>, y, = 1 and 7; > 0 from y, > 0. 


Furthermore, >>, vi¢y% = 0 implies >>, di,y, = 2 and thus 5°, DL yl(i5) eT} Yk = 2, 80 


that 
tit Vad LV w=? 
j>i j<i I {kl(i,9)ET} 
Moreover, 1-trees have one unique cycle, which contains node 1. So for any 1-tree, 


1 
{(4,9) (4, ET 1,5ES} 

Yk 

{ING INET 25ES} 
Ds oe Yk 

Kk {Gj GI)ETRs 4.5 €S} 
Yk 

1,7€S {k|(i,7) ET, } 


oer zy, = [S]—1 DS Aeeesey} 
2,j9ES 


IA 


|S|—1 for any k,S C {2,...,n} 


IA 


yx(|S|-—1) for any k,S C {2,...,n} 


IA 


[Slt Bee wnt 


lA 


IS}-1 SC {2,...,n} 


Thus the subtour elimination constraints are satisfied. The remaining constraints 


for the sets S that include node 1 are implied by the previous constraints. Fi- 


nally, >>, CeY¥% = Davee cn do {kI(i3)ETe} CiiYk = pReerare’ €4j2ij, So the two feasible 
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solutions have the same cost. Since Fj; = Le yal(ig)eTe} Yeo Zig > 0 if and only if 
there exists k such that (i,j) € T, and y, > 0. Hence (2,7) € Epp if and only if 
(i,j)€ Ecc. 

Thus we can work with the convex combination of 1-trees, knowing that an 
optimal solution to this LP will produce the same set of edges as an optimal solution 
to the Subtour LP. We will now prove that given an embedding with the right 
properties, we can draw straight lines for all edges in Eco without having any lines 


intersect. 


Theorem 2.1.3 Let p,...,pn be the embedding of the nodes of an instance of the 
TSP such that the embedding has the box property, and such that no three points p; 


are colinear. Then there exists an optimal solution to the Subtour LP that is planar. 


Proof: Let y be an optimal solution to (2.1). Draw a straight line segment between 
p; and p; for all (1,7) € Ecc. Suppose that two of these line segments intersect. Call 
them (p;,p;,) and (p;,p;). Since no three points are colinear, p;, pj, Pe, and p, must 
form a convex quadrilateral. The two line segments (p;, p,) and (p;,p;) correspond 
to edges (i,k) and (7,1). Suppose that both edges (i,k) and (j,/) are in a single 
1-tree, T,. Since any 1-tree is connected and (7, k) and (j,/) are in Tj, there exists a 
path in 7, either from i to j, from j to k, from k& to 1, or from I to i that does not 
pass through either of the other two nodes. Without loss of generality, suppose that 
the path is from 7 to 7, and it does not pass through k or /. Create a new 1-tree T, 
from T, by removing (?,k) and (j,/) and adding (7,/) and (j,k). The path from i 
to j ensures that T, is connected. See Figure 2.1. Let y, = yz for k # q,r, and let 
Yq =O and yf, = yr + yg. It is not difficult to see that since y is feasible for (2.1), so 
is y’. By the box property, since p;, p;, Pr, pj formed a convex quadrilateral, we have 
Ci + Cjk < Cig +¢;1. Therefore, >, chy, < >>, ceyk- This contradicts our hypothesis 
that y is an optimal solution to (2.1). 

Now suppose that the edges (i,k) and (j,/) corresponding to the crossing line 
segments come from two different 1-trees, (i,k) from T, and (j,/) from T,. Without 
loss of generality, suppose that y, < y,. There are two classes of ways that T, and T, 
can be connected, so again, without loss of generality, we will pick one example from 


each class and assert that the other cases in each class are similar. For the first class, 
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Figure 2.1: Example if crossed lines are in a single 1-tree 


we will say that TJ, has paths from 7 to j and from k tol (without going through k,/ 
and through i,j respectively), and T, has paths from 7 to j and from 7 to k. In this 
first class of cases, we are able to remove the “diagonal” edges from the trees and 
replace them with “opposing sides” while keeping the 1-trees properly connected: in 
this case, we create Tj; from T, by removing (i,k) and adding (j,k), and T,, from T, 
by removing (j,/) and adding (7,1). We set yf4 = YgitYq, Yiq = YritYar Yr = Yr—Yoo 
y, = 0, and y = y, elsewhere. y’ is feasible for (2.1) since y is, but the difference 
in cost between the two solutions is y,(¢y + ¢;4) — Yg(ci + ¢j1). This difference is 
negative by the box property, so y’ is a cheaper solution to (2.1), contradicting the 
optimality of y. 

For the second class, we will say that 7, has paths from i to j and from k to 
Il, and 7, has paths from 7 to ! and from j to k (again, the paths do not visit the 
other two nodes). Create four new 1-trees: T,, from T, by deleting (i,k) and adding 
(j,k), Tq2 from T, by deleting (t,4) and adding (i,/), T,, from T, by deleting (j,/) 
and adding (7,7), and 7,2 from T, by deleting (j,/) and adding (k,1). See Figure 2.2. 
It is not difficult to check that all the new 1-trees are properly connected. Now, let 
Yor = Yat FYar Yoo = Yor t F Yo. Yer = Yrit3Yqs Yeo = YratSygs YE = Yr—Yos Vy =, 
and y, = yx elsewhere. Since y is feasible for (2.1), so is y’. However, the difference 


in cost between the two solutions is $Yq(Cij + ejk + cei + cri) — Yqg(cik + 51). By the 
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box property this difference is negative, so y’ is a cheaper solution, contradicting the 
optimality of y. 

In all cases, the existence of crossing line segments leads to a contradiction. Thus 
the embedding of the TSP instance must yield some optimal solution F such that 
G = (V, Epp) has a plane representation for that embedding. By previous discussion, 
this proves that % is planar. 

In the case of the Euclidean TSP, there is a natural “Euclidean embedding” of 
the nodes into points in the plane such that for any nodes 7 and j, cj; = d(pi,p;), 
where d(p;, p;) is the Euclidean distance between points p; and p;. We will show that 
given this Euclidean embedding for an instance of the Euclidean TSP, there is always 
an optimal solution to the Subtour LP that is planar. We will do this by showing 
that the Euclidean embedding always has the box property, and that we can drop 


the restriction of colinearity from the theorem above. 


Lemma 2.1.4 The Euclidean embedding for a Euclidean TSP instance always has 
the box property. 


Proof: Let pi,...,pn be the Euclidean embedding of nodes 1,...,n from a Euclidean 
TSP instance. Pick any four distinct nodes i,7,k,/ such that the line segments 
(pi, Pj), (Djs Pk), (Pr, Pt), and (pj, p;) define a convex quadrilateral. Then the diagonals 
(pi, Pk), (pj, P1) Of the quadrilateral intersect at exactly one particular point in 8. 
Call this point q. Since q does not lie on the any of the line segments (p;, p;), (Pi, Pt), 
(pi,p;), and (p;, p.), the following statements hold under the Euclidean metric: 


© d(pi,p;) < d(pi,q) + d(q,;) 
© d(px, pi) < d(pe,@) + d(q, pi) 
© d(p,pi) < d(pr,q) + 4(q, Pi) 

© d(p;, Pe) < d(p;,q) + d(q, De) 


Adding the first two statements together gives d(p;,p;) + d(pe,p) < d(pi,g) + 
d(q,px)+4(p;,¢)+d(q, p), and adding together the last two gives d(p;, p)+d(p;, Dk) < 
d(pi,g) + d(q, px) + d(pj,q) + d(q,p1) (using symmetry). But d(pi,q) + d(q, px) = 
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Figure 2.2: Example if crossed lines are from two 1-trees 
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d(p;,p,) and d(p;,q) + d(q,p,) = d(p;,p1), since q lies on the line segments (pj, px) 
and (p;,pi). Because this is a Euclidean embedding of a Euclidean TSP instance, 
cij = d(pi,p;), ckt = d(pe, pi), and so forth. Thus cj; + ce < cik + €;1 and ci + Cj~ < 
Cik + Cj). 


Finally, we remove the restriction on colinearity for the Euclidean TSP. 


Theorem 2.1.5 Given the Euclidean embedding for an instance of the Euclidean 


TSP, there exists an optimal solution to the Subtour LP that is planar. 


Proof: Observe that for the Euclidean TSP d(p;,p;)+d(pz, m1) < d(pi, pe) + d(p;, p1) 
and d(p;, p1)+d(p;, pe) < d(p;, pp) +4(p;, pi) even when p; or 7 lies on the line segment 
(pi,pk), Or when p; or px lies on the segment (p;,p;). Hence, using the reasoning 
found in Theorem 2.1.3 and Lemma 2.1.4 above, intersecting line segments of this 
type contradict the optimality of y, the optimal solution to 2.1. 

We must now handle the general case when three or more points are colinear. Let 
= be an optimal solution to the Subtour LP, with the subtour elimination constraints 
replaced by Dies jg¢5 Tij 2 2 constraints. By the reasoning above, drawing straight 
line segments for all edges in Eyp yields no intersecting line segments unless all 
the points corresponding to the intersecting segments are colinear. Without loss of 
generality, suppose that points p,,...,px are colinear, in numerical order on the line. 
Suppose also that drawing straight lines for all edges in Eyp causes lines to be drawn 
through points p2,...,pe—1; that is, for each node i € {2,...,k — 1}, there is some 
edge (a,b) € Epp withl<a<i<b<k. 

Let S = {1,...,k}. Let to = Digs Ti; and th = 0jg5%4j- Furthermore, we set 
ti = Visa<icb<k Fab fort =1,...,k —1. That is, ¢; will be the sum of the T,, that 
“get drawn” between nodes i and i+ 1. Since the degree of nodes 1 and k is 2, it 
follows that to + t; = 2, and t,_1 +t, =2. 

Suppose S$ # V. Since F is a solution to the Subtour LP, we know that 
Dries,j¢s ij 2 2. For? € {2,...,k—1}, there is no (7,7) € Epp with 7 ¢ S. If there 
was such an edge (i,7), then since there exists an edge (a,b), 1<a<i<ob<k, 
with p; on the line segment (pa, p,), we have a contradiction by the discussion of the 
initial paragraph. Therefore, Dies j¢5%ij = Djgs(Fij + Taj) = to +t, > 2. Using 
S’ = {1,...,k —1} and $” = {2,...,k}, one can show similarly that tp + t,_1 > 2 
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and #3 +t, > 2. Solving with the equations above yields tp = 4) = tp_1 = ty = 1. 
Then using S* = {i+1,...,k}, we get t; +t, > 2, which implies t; > 1. We now 
construct a new solution to the Subtour LP which has no greater cost: %} 44, = 1 
fori = 1,...,k —1, ¥; = 7; for j > k, Th, = %,; for 7 > k, and Ei) = %1-for 
j,1 > k. Clearly for the Euclidean TSP this solution has no greater cost, since in 
the old solution t; > 1. The node degree constraints are satisfied, since each node 
has degree 2. Suppose that there is some set T such that Vier jgr 4; < 2. Then it 
must be the case that TN S = {1,...,i}or TNS = {i,...,k} for 1 <i< k. For 
any other possible T'S, it is clear that D;erjgr Tj; > 2. If some set of the form 
TOS = {1,...,i} or TNS = {i,...,k} is infeasible for 7’, then TU S must also be 


infeasible for 7’. 


However, this implies T U S was infeasible for %, a contradiction. 
Hence @ is an optimal solution for the Subtour LP, and it no longer has intersecting 
line segments for the colinear points p),..., px. 

Suppose S = V. Using arguments similar to those above, it can be shown that 
t; > 2 for 1 <i<n-—41. Hence the solution T} 544 = itor hae 41, 2 ST 
is of no greater cost. Since the solution is a tour, it is clearly feasible, and it can be 
drawn in the plane by using straight line segments between p; and p;4, for the edges 
(t,t +1), and a curve between p; and p, for the edge (1,7). 

Planarity may be useful in discovering further structure of solutions for the Sub- 
tour LP, and perhaps even proving tight lower bounds. Planar graphs have many 
nice properties not shared by their non-planar counterparts. For instance, it is known 
that every 4-vertex-connected planar graph has a Hamiltonian cycle (that is, a tour) 
[35], [36]. 


2.2 Monotonicity of Solutions 


The Held-Karp heuristic on symmetric instances of the TSP with triangle inequality 


has a certain monotonicity property, which we will define and prove in this section. 
2 
3 
lower bound on the cost of Subtour LP solutions. That is, the Held-Karp heuristic 


As a consequence of this theorem, we derive an alternate proof of Wolsey’s y = 


will always produce a solution that has cost no less than 2OPT. Monotonicity will 


allow us to prove this statement by bounding the value of the Held-Karp heuristic 
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on subsets of nodes in a useful way. 

Let V = {1,2,...,n} be the set of nodes, and let O C V. Let W be the cost 
of the Subtour LP, and let Wo be the cost of the Subtour LP on the node set O. 
We will say that the Subtour LP is monotone if for any TSP instance with node 
set V, and for any O C V, Wo < Wz. If n < 5, then it is well known that the 
extreme points of the polytope defined by the Subtour LP (1.1) are integral [16]; i.e., 
they correspond to tours. Thus, in this case, the triangle inequality implies that an 
optimal tour on V can be shortcut to yield a tour on O that is no longer. So the 
Subtour LP is monotone for n < 5. Consider next n > 5. By observing that the 
Subtour LP (1.1) is independent of the choice of the special node 1, we can assume 
that, without loss of generality, O = {1,...,2 — 1} = [n — 1]. We shall show that 
assuming Wi,_1) > W leads to a contradiction. We will draw heavily on Held and 
Karp’s alternate formulation of the Subtour LP as an optimally weighted 1-tree. 


Define the adjusted cost of a 1-tree T, with respect to m to be 


n 
Ca t y Tj Via- 
t=1 


Note that when 7, is the minimum-cost 1-tree with respect to 7, its adjusted cost 
is w(x). Let T = T, and F = (7%,...,%n-1) be the optimal 1-tree and the optimal 


Lagrangean multipliers for [n — 1], respectively, so that 


n-1 
Wr-1] =chet+ So Fiviz- (2.2) 


w=1 
We first show that T and 7 can be picked such that the two edges adjacent to 


node 1 have the same reduced cost. 


Lemma 2.2.1 There exists a vector F for [n—1] for an optimally weighted 1-tree T 


such that if node 1 is adjacent to nodes x and z, tiz = Tiz- 


Proof: Suppose that in T, node 1 is adjacent to nodes x and z, and t, < %@,. This 
implies that (1,2) must be the single cheapest edge adjacent to 1, so all optimal 
1-trees with respect to the Lagrangrean multipliers 7 must include (1,2). Consider 


again the linear program (2.1), the convex combination of 1-trees. By complementary 
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slackness, each tree T, for which y, # 0 in (2.1) is an optimal 1-tree with respect to 
7 in the dual LP (1.2). As noted above, (1,z) must be in each of these trees. The 
node x will have degree at least two for each tree, as it will be in the unique cycle of 
the 1-tree. Since the convex combination of 1-trees forces the average degree of each 
node in the trees to be 2, x must have exactly degree two for each tree in the dual 
solution. 

Pick one such tree T;,. Since x has degree 2, increasing 7, will not change the 
adjusted cost of 7, from the optimum value, W,,_1). We show that this does not 
affect the optimality of the spanning tree of T; on 2,...,n — 1. Increasing 7, does not 
affect the relative order of the reduced cost of edges incident to z, and does not affect 
the reduced cost of any other edge. Since z is a leaf in this spanning tree, the edge 
incident to z is the cheapest such edge, and if ¥, is increased a minimum spanning 
tree will contain this edge. Clearly, all other edges will remain in the spanning tree 
as well. 

If node z is also adjacent to node 1, and we increase 7, by @1z—Ciz, then (1,7) and 
(1, z) are still the two cheapest edges adjacent to 1, but t, = t,. By the arguments 
above, T, is a minimum-cost 1-tree with respect to the modified multipliers 7 such 
that T; has adjusted cost W,,_1). Thus T, and the new 7 are optimal solutions to 
the equation (2.2). Ml 

We will now assume that Wr- 1] > W and show that this leads to a contradiction. 
Let T(7,) be the minimum-cost 1-tree on V with respect to 7 for nodes in [n — 1] 
and m, for node n. If the adjusted cost of T(7,) is greater than or equal to W,_4) 
for any m,, then by supposition it is greater than W. Thus we have found a vector 
x for which the minimum-cost 1-tree on V has adjusted cost greater than W, which 
contradicts the maximality of W. 

Thus, T'(7,) must have adjusted cost less than Wj,_1). We will show that we can 
delete node n from some T(7,,) such that the adjusted cost of the resulting 1-tree 
is no greater, which contradicts the minimality of T with respect to F. Thus the 
supposition W < W,,_1; must be false. 


We now show that there exists 7, such that n has degree two in T'(7,,). 


Lemma 2.2.2 If node n in T(m,) has degree k < n—1, then there exists 6 > 0 such 


32 CHAPTER 2. THE SYMMETRIC CASE WITH TRIANGLE INEQUALITY 


that n has degreek + 1 in T(x, — 6). 


Proof: By the definition of a minimum-cost 1-tree, T(z,,) is a minimum-cost span- 
ning tree on V — {1} plus the two cheapest edges adjacent to node 1, all with respect 
to the reduced costs ¢;;. We can assume that the minimum-cost spanning tree is 
constructed as follows: sort the edges in non-decreasing order by reduced cost; in- 
clude in the tree those edges that connect two connected components in the graph 
induced by the edges that come earlier in the ordering. Note that by changing 6, 
only the costs of edges incident to n are altered, and these changes can only move 
those edges earlier in the order. Furthermore, if an edge is included, it will still be 
included after moving it earlier in the order. 

For a particular value of 6, there may be many orderings of the edges consistent 
with the reduced costs (due to ties in the values). In an ordering, we can interchange 
any two edges of the same reduced cost. Perform a series of interchanges, bringing 
the edges incident to n earlier in the order, one step at a time. If the degree of n 
increases as a result of one of these interchanges, we have proved the lemma. Next 
consider the edges incident to node 1, and check if the edge (1, n) is of the same cost 
as one of the edges in the current solution. Again, if the degree of node n increases, 
we are done. 

Apply the above argument with 6 = 0. If this fails to produce the desired tree, 
increase 6 until the reduced cost of one of the edges incident to n equals the reduced 
cost of one of the other edges in the graph, and then repeat the procedure given 
above for a the new value of 6. Note that if 6 is sufficiently large (greater than 
max;{@j,} — min;,;{@;;}) then the degree of node n must become n — 1. Therefore, 
the procedure given above must terminate and give a 1-tree in which node n has 


degreek +1. WI 
Corollary 2.2.3 There exists a value T, such that node n has degree two in T(r). 


Proof: This follows from Lemma 2.2.2 and and the observation that if 7, is suffi- 
ciently large, then it must have degree 1 in any minimum-cost 1-tree. 


We can now prove the theorem. 


Theorem 2.2.4 W,_1) < W and thus the Subtour LP is monotone. 
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Proof: Assume, as we have above, that Wi,_1; > W, and that T = 7, and F are the 
optimal 1-tree and multipliers for [n — 1]. Let 7, be such that node n has degree two 
in T(%,) = Ta, and let w and z be the two nodes adjacent to n. If (w,x) is not in 
Ta, then form the 1-tree T, by removing edges (w,n) and (x,n), and adding (w, 2). 
Since Ung = 0, Vig = Vip, ANd Cyg < Cue + Cnw, 


et ey Five < cat Tn tna + oo a (2.3) 
< Ck + Vidi Titik, 

which contradicts the minimality of T(= T,) with respect to the multipliers 7. 

Suppose that the edge (w,z) is already in T(7,). This means that there is a 
cycle (n, w, 2), and since node 1 is in the unique cycle in a 1-tree, either w or z 
must be node 1. Say that w = 1. By the optimality of T(7,,), (1,2) must be one of 
the edges adjacent to node 1 in T. By Lemma 2.2.1, there exists another edge (1, z) 
with G1, = Ciz. So we can remove edge (1,2) and add (1,z) without affecting the 
optimality of T(7,). (1,2) = (w,z) is no longer in the tree, so we can shortcut node 
n as above. 

This establishes the desired contradiction, so it must be the case that Wr-y S 
WwW. 

This theorem was also obtained independently by Goemans and Bertsimas [13]. 

To achieve the same 7 = Z lower bound on the cost of the Subtour LP as Wolsey 
[39], we use a result of Christofides. Christofides [3] observed that if T is the cost 
of a spanning tree, and M is the cost of a matching on the odd-degree nodes of the 
tree, then M +7 > OPT. This comes from the fact that a tree plus a matching on 
the odd-degree nodes yields an Eulerian graph. By starting with an Eulerian circuit 
of the graph and shortcutting any multiply visited nodes, we can obtain a tour no 
longer than the total length of edges in the Eulerian graph. The same holds true if 
a 1-tree is used instead of a spanning tree. 

If we assume that there is an even number of nodes, the cost of a matching can 


be bounded in terms of W. 


Lemma 2.2.5 Let M be the cost of the minimum-cost matching, assuming that 


n= |V| is even. Then M < 4W. 


34 CHAPTER 2. THE SYMMETRIC CASE WITH TRIANGLE INEQUALITY 


Proof: Let F be an optimal solution to the Subtour LP. Then 57 satisfies the 


following constraints: 


Seg + > 2 =. 1; ee E22 (2.4) 


j>t j<i 
1 
tj < 5(lSl-1), SCV, |S| > 3, |S| odd, 
tES JES ASG 
Tij Se oly l<i<g<n, 
rij > O, l<icg<n. 


By a classic result of Edmonds [6], these are exactly the constraints for the linear 
programming formulation of the matching problem. Since the objective function for 
the two LPs is exactly the same (min Doiciejcn cj2ij) and $5 is a feasible solution 
to (2.4), the cost of the matching is no greater than half the cost of the Subtour LP. 
Thus M < iW. | 

Pick a minimum-cost 1-tree T, with 7; = 0, for all 7. This implies c, < W. Let 
O CY be the odd-degree nodes of T. Then 


OPT < e+Mo (2.5) 
OPT < W + 5Wo (2.6) 
OPT < wtsw (2.7) 
OPT < sw 
<OPT < Ww 


Equation (2.5) follows from Christofides’ technique, (2.6) follows from Lemma 
2.2.5, and (2.7) follows from the monotonicity theorem. Therefore, W, the value 
of the Subtour LP, is bounded above by OPT and bounded below by 20PT. We 
note that this result shows that the Held-Karp heuristic does as well as the best- 
known tour-constructing heuristic for the symmetric TSP with triangle inequality. 
Christofides’ heuristic [3] is guaranteed to construct a tour with cost no greater than 


20PT. 
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They = 2 lower bound for the Held-Karp heuristic is not known to be tight. The 
worst case known is a family of graphs shown in part (a) of Figure 2.3, which was 
introduced by Monma, Munson, and Pulleyblank [27] in a slightly different context. 
Let the distance from any node i to any node j of the graph be the number of edges 
in the shortest path between i and 7. This yields an instance of the TSP that is 
symmetric and obeys the triangle inequality. Part (b) of the figure shows an optimal 
tour of the graph of cost 4k + 2. Part (c) shows a feasible solution to the Subtour 
LP of cost 3k +3. Since there are 3k + 2 nodes in the graph, and each edge costs 
at least one, the cost of the optimal solution to the LP is at least 3k + 2. Then the 
ratio of the cost of the LP solution to the cost of the optimal tour is between 3 
and oon Notice that this ratio tends to 3 as k tends to infinity. We conjecture that 


the actual lower bound for the Held-Karp heuristic is y = 3. 


2.3. Connections to the Biconnected Graph Problem 


Monma, Munson, and Pulleyblank [27] have shown that there are interesting connec- 
tions between the TSP, the Held-Karp heuristic, and another V P-complete problem, 
the minimum-cost biconnected-graph problem. We say a graph G = (V, E) is bicon- 
nected if the graph is connected, and the removal of any edge does not disconnect 
the graph. Given costs c;; the minimum-cost biconnected-graph problem is to find 
E’ such that G = (V, E’) is biconnected and 


» 


(1,3) €E! 


de Mi 


Cia — min 
{s|(G,S) biconnected }Gnes 


Eswaran and Tarjan [8] have shown that the minimum-cost biconnected-graph prob- 
lem is ’P-complete even when edge costs are either 1 or 2. 

Monma, Munson, and Pulleyblank have shown that if the cj; are symmetric and 
obey the triangle inequality, then the minimum-cost biconnected graph is a y = 3 
lower bound for the TSP*. They also show that this bound is tight, by using the 
same family of graphs as our conjectured worst-case instance for the Held-Karp 
heuristic. Furthermore, they include a result of Cunningham that shows that the 


optimal solution to the Subtour LP has cost no greater than that of the minimum-cost 


?Frederickson and Ja’Ja’ [10] showed earlier that this was true for planar graphs. 
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Figure 2.3: Conjectured Worst Case for the Held-Karp Heuristic 
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biconnected graph. 
We draw an additional connection to the minimum-cost biconnected-graph prob- 
lem by relating the value of its linear relaxation to the value of the Held-Karp heuris- 


tic for non-negative c;;. Consider the following linear program: 


minimize Pe Cijkij (2.8) 
1<i<j<n 
subject to: > 2iz + per > 2; Qe De Sig My 
j>t g<t 
ye ae 2s for any proper subset SC V, 
i€S JES i<j 
ae l<t<j<n, 
“i; 2 O, 1<i<cgj<n. 


As with the Subtour LP, if the z;; in LP (2.8) were guaranteed to be either 0 or 
1, the solution would be the minimum-cost biconnected graph. Therefore (2.8) is a 
linear relaration of the biconnected-graph problem in the same way that the Subtour 
LP is a linear relaxation of the TSP. If we let W be the cost of the optimal solution 
to Subtour LP and B be the cost of the optimal solution to (2.8), it is not too hard 
to see that B < W. If the subtour elimination constraints of the Subtour LP are 
replaced by Vices jgsicj tij 2 2 constraints, any z that is feasible for the Subtour 
LP is feasible for (2.8), and so B < W. We show that W and B are in fact equal for 


a large number of cases. 
Theorem 2.3.1 [fc¢;; > 0 for alli,j, then W = B. 


Proof: Define the potential function ® to be 
(2) = ves Liz + pa — pay 
a j>t gst 
Intuitively, ®(z) is the total amount that the degree of each node in a solution to 
the biconnected LP (2.8) exceeds 2. Pick the vertex z of the polytope defined by the 


biconnected LP such that Dri <jcj<n Cij7ij = B (that is, x is an optimal vertex), and 


such that ®(z) is minimized. If (2) = 0, then we are done, since zx will be feasible 
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for the Subtour LP, implying W < B and thus W = B. Suppose that ®(z) > 0. 
We will derive a contradiction by finding a feasible point F of no greater cost (7.e., 
@ is optimal) such that ®(F) < ®(z). Since F is the convex combination of optimal 
vertices and ® is a linear function, there must exist some optimal vertex z’ of the 
polytope with ®(2’) < ®(x). The existence of 2’ will complete the contradiction. 
Recall that a multigraph is a graph such that there may be more than one edge 
between any two nodes, and an Eulerian graph is a graph in which each node has 
an even number of edges incident to it. Our proof relies heavily on the following 


theorem of Lovasz about Eulerian multigraphs. 


Theorem 2.3.2 (Lovadsz [25]) Let G be an Eulerian multigraph, z a node of G, 
and (z,u) an edge of G. Then there exists another edge (z,v) in G such that in the 
graph G’ formed by removing (z,u) and (z,v) from G and adding (u,v) 


cgi (a,b) = eg(a,b) 


where a,b are any two nodes of G distinct from z, and where cg(a,b) denotes the 


number of edge-disjoint paths between a and b. 


We will convert our optimal vertex x into an Eulerian multigraph by multiplying 
each z;; by a constant factor. Since x is a vertex of the polytope, the 2;; must be 
rational. Thus we can find some least common denominator q of £12, 713,.--,;2n-1,n- 
The multigraph G, induced by 2qz (that is, the graph with 2q2,;; edges between 
nodes 2 and 7) is then an Eulerian multigraph. 

Choose a node z such that oe €2j + Vijcz zi > 2. Such a node z must exist 
since @(z) > 0. Then z must have degree at least 2g +2 in G,;. Apply Lovasz’s 
theorem to z in Gz for some arbitrarily chosen u such that (z,u) is in Gz. The 
theorem produces a new graph G, that shortcuts the node z; that is, edges (z,u) 
and (z,v) are removed for some v, and edge (u,v) is added. Consider the vector = 
with Z,; equal to the number of edges (7,7) in Gz divided by 2g. It will be shown 
that if 7, < 1, then we are done. Otherwise there will be two cases to consider. 


First we suppose that F,, <1. 


Lemma 2.3.3 [ff yy, <1, then T is a feasible point for the biconnected LP such that 
the cost of f is no greater than the cost of c and ®(Z) < ®(2). 
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Proof: By construction, fy, = uv t ges Bou = Loy - # Dey = fey ie and 23; = vi; 
everywhere else. Thus certainly ®(Z) < ®(z), and also the cost of ¥ is no greater 
than the cost of x by the triangle inequality. Since z had degree at least 2q + 2 in 
Gz, it must have degree at least 2q in G,, and hence at least degree 2 in 7, so all 
the node degree constraints of the biconnected LP are satisfied. Likewise, because 
(z,u) and (z,v) were in Gz, try > 2 and 2, > . so > 0. By the assumption and 
observations above, F< 1. 

Finally, we need to show that the Tics ;gsicj Fij 2 2 cut constraints are obeyed. 
Since Dies j¢sicj Tij 2 2, it follows from the max-flow min-cut theorem that 
cg, (a,6) > 4q for all distinct nodes a and 6. By Lovasz’s theorem cq (a,b) > 4q for 
all nodes a and b different than z. Hence for every subset S such that there exists 
a€S,b¢ S,with a,b #2, Vices igsic; Fij 2 2. The only case in which this does not 
occur is when S = {z} or S = {z} in which case these cut constraints follow from 
the node degree constraint for z. Ml 

Now we suppose that the lemma does not apply; that is, there does not exist 
edges (z,u) and (z,v) such that Lovdsz’s theorem applies without causing Ty, > 1. 
There are two cases to consider. First, suppose that for every pair of edges (z, u) and 
(z,v) adjacent to z, 4, = 1. There must exist at least three distinct points u,v,w 
with tzu > 0,%2 > 0, and x,y > 0 (otherwise, the degree of z can’t be greater than 
2). Also note that z,, > 0 implies that z,, > ; and similarly for the other edges. 
By assumption, tyy = Cow = Tu» = 1. Then we assert that setting Fy, = Tuy — 7 
and %;; = 2;; elsewhere produces a feasible point F for the biconnected LP. It has no 
greater cost (since cy, > 0) and ®(F) < ®(x) (since the degree of u has decreased). 
The feasibility of ® for all constraints follows straightforwardly except for the cut 
constraints for which u € S,uv ¢g S. Then we have the following cases: 


e z,w € S implies ES JES i<j Lig > Luv t+ Low tay 22+ a 


e z€S,w ¢ S implies ies jESi<j Nip Bug Cy eye ee re 


@Zz ¢ S,w E S implies ies jgSi<j @i3 > Luy + Louw + Lew > 2 + a 


e z,w ¢ S implies ies jeSi<i ti 2 law FP ty S 2 7 
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Figure 2.4: Case 1 if Lemma 2.3.3 does not apply 


In every case the cut is not less than 2 + = so we can certainly reduce zy, by ir 
See Figure 2.4. 

The second case to consider if Lemma 2.3.3 does not apply is when (z,v) and 
(z,w) are non-zero edges with z,,, < 1, but choosing (z, v) causes Lovadsz’s theorem 
to choose (z,u) such that zy, = 1, and choosing (z, w) causes the theorem to choose 
(z,y) with ty, = 1 (possibly u = y). It turns out that in this case we can obtain 
a feasible point F by setting Fy, = tow + oe Bey = Ley — Ee Few = Lew — oon and 
Zi; = vj; everywhere else. Again, showing that the cost of ¥ and ©(Z) are no greater 
than those of z is trivial. Likewise, showing feasibility for all constraints is easy 
except for the cut constraints in which z € S, v,w ¢ S. Since Lovasz’s theorem says 
we could have shortcut to (u,v) or to (w, y), it follows that for all S with z € S and 
either u,v ¢ S, or w,y Z S, ies j¢Si<j Tig 2 2+ a So the only case remaining is 
when u and y arein S. Then ies jESi<j Tig Z Tuvtlwyt Tw 2 oe Thus, we can 
produce an & by shortcutting to (v, w) without violating any of the cut constraints. 
See Figure 2.5. 

In every case, we have produced a feasible point F with the necessary properties, 
so we have reached a contradiction, and the theorem is proven. 


A more general version of this theorem was proven independently by Goemans 


and Bertsimas [13], also by using Lovasz’s theorem. 
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Figure 2.5: Case 2 if Lemma 2.3.3 does not apply 


That W = B is true in a large class of instances is somewhat surprising, especially 
since the minimum-cost biconnected graph generally does not have the same cost as 
the minimum-cost tour in the same class of instances. The equality of W and B 
also implies that we have another equivalent formulation of the Held-Karp heuristic 
in the biconnected LP. Goemans and Bertsimas [14] use this formulation in their 
probabilistic analysis of the Held-Karp heuristic; it is possible that this formulation 


will continue to be useful in further analysis of the heuristic. 


Chapter 3 


The Asymmetric Case with 
Triangle Inequality 


A TSP instance is said to be asymmetric if it is not necessarily the case that c;; = 
c;; for all 1,7. The asymmetric case seems to be harder than the symmetric case 
of the TSP: even with the triangle inequality, the best known tour-constructing 
heuristic has a = [log n] [11]. Non-constructive heuristics seem to do as well as their 
symmetric counterparts, however. A lower-bound heuristic of Balas and Christofides 
[1] produced values that were usually 99.5% OPT in one study of the heuristic [4]. 
The Held-Karp heuristic on asymmetric instances is also doing well. We will show 
that the Held-Karp heuristic has a guarantee of y = Toaxt and has a bound no less 
than that of the Balas-Christofides heuristic. 


3.1 Definition of the Asymmetric Held-Karp Heuristic 


First, we must define the Held-Karp heuristic in the asymmetric case. An arbores- 
cence on a directed graph G = (D, A) is a tree such that each node of the tree has 
indegree one with the exception of a distinguished node known as the root, which has 
indegree zero. Thus there is a directed path from the root to every other node. A 
1-arborescence is an arborescence having node 1 as the root and one additional arc 
(t,1). So a 1-arborescence has exactly one directed cycle, which contains node 1. As 
in the symmetric case, the 1-arboresence can be weighted by Lagrangean multipliers 


a = (a1,...,Q,), so that the minimum-cost 1-arborescence is chosen with respect to 


42 
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reduced costs @; = cj; + a;. If T;, is the minimum-cost l-arborescence with respect 
to a, and 
n 
wia)= Dy tj - dla, 
(1,9) €T t=1 
then the value of the Held-Karp heuristic in the asymmetric case is max, w(@). 
Held and Karp [17] noted that their results for the symmetric case carried over 
straightforwardly to the asymmetric case. In particular, their statement implies that 
the value of the Held-Karp heuristic is equal to the value of the following linear 


relaxation of the asymmetric TSP: 


minimize De. ees (3.1) 
1<ij<n 
subject to: Nr =" 4, j=l,...n, 
t 


) “i; = 1, 2~=1,...,n, 
j 
) Lij 


1€S,3ES 
wiz 2 9, l1<tjgn. 


lA 

ah 
| 

a 


for any proper subset 5 CV 


Held and Karp do not formally prove that max, w(a) and the value of the LP (3.1) 
are equal. We will do so here by using a powerful theorem of Geoffrion. Geoffrion 
[12] examines Lagrangean relaxation in a general setting by considering the following 


linear programs: 


minimize Cz 
subject to: Az > Jb, 
Be > d 3-2) 
z > 0, 
f(A) = minimize cx+A(b—- Az), 
subject to: Be > d, 
SO: (3.3) 
Qi integer, 


where A is fixed, and, 
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maximize over \ f() 
subject to: A; > Owhen A;x > 6;, (3.4) 
\G unrestricted when A;z = 0;. 


Geoffrion then shows the following theorem. 


Theorem 3.1.1 (Geoffrion [12]) Suppose that for all feasible , the optimal value 
of (8.3) is not altered by dropping the integrality constraints. Then the optimal value 
of (3.2) is equal to the optimal value of (3.4). 


Now we can prove Held and Karp’s theorem for the asymmetric case. 


Theorem 3.1.2 (Held, Karp [17]) Let W be the optimal value of the asymmetric 
Subtour LP (3.1). Then W = maxg w(a@). 


Proof: To apply Geoffrion’s theorem, we have c correspond to the c;;, x correspond 
to the z;;, Az > b correspond to the constraints 57; 2;; =1,7=1,...,n,and Br >d 
correspond to both $0; 2;; = 1,7 = 1,...,n, and the subtour elimination constraints 
Dies jes tig < |S|—1 for any SC {2,...,0} or any S = {1,k} for k € {2,...,n}. 
First, notice that the optimal value of (3.2) will be the same as that of the asymmetric 
Subtour LP (3.1)!. Second, if the 2;; are forced to be integers, then only vectors x 
corresponding to 1-arborescences satisfy the Bx > d constraints. Hence we can view 
the linear program (3.3) as finding the l-arborescence that minimizes cx — A(b— Az). 
But cx — A(b— Az) = D0; j(cij + Ai)@ij — D0; Ai, SO Minimizing this quantity is the 
same as finding the minimum-cost 1-arborescence with respect to 4. Therefore, the 
value of the LP (3.3) is equal to the value of w(A), and the value of (3.4) is the same 
as the value of the Held-Karp heuristic. 

It will follow that the optimal value of the asymmetric Subtour LP is equal to 
the value of the Held-Karp heuristic if the polytope Bz > d has integer extreme 
points. By a theorem of Edmonds [7], Bx > d has integer extreme points because 
it represents the intersection of two matroids (the 1-tree matroid and the indegree 1 
matroid). i 

The choice of which constraints from the asymmetric Subtour LP to assign to 
Az > 6 and which to assign to Br > d was somewhat arbitrary, so it turns out 


’ As before, the missing constraints are implied by other constraints. 
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that we can prove similar theorems not considered by Held and Karp. We state 
a few of the possible theorems below. A few terms need to be defined first. A /- 
antiarborescence is the same as a 1-arborescence, except that each node is constrained 
to have outdegree 1, rather than indegree 1. An asymmetric 1-tree is a directed graph 


whose underlying graph is a 1-tree. 


Theorem 3.1.3 Define the minimum-cost 1-antiarborescence with respect to a real 
n-vector B = (f,,..., 8) to be the minimum-cost 1-antiarborescence with respect to 


edge costs €;; = ci; + Bj. If T, is the minimum-cost 1-antiarborescence with respect 
to 8, define 
n 
w(B)= Sti — 7B; 
(4,3) €Tk j=l 
Then maxg w(f) = W. 


Theorem 3.1.4 Define the minimum-cost asymmetric 1-tree with respect to the real 
n-vectors @ = (Q1,...,@,) and B = (f1,...,Bn) to be the minimum-cost asymmetric 
1-tree with respect to edge costs t; = cj; +a; + Bj. If T, is the minimum-cost 
asymmetric 1-tree with respect to a,G, define 


n 


wla,B)= S> ty- dSo(a + Gi). 


(1,7) ET, i=1 


Then max,g w(a, 8) = W. 


Theorem 3.1.5 Inder all the proper subsets S C V by q, so that there are z proper 
subsets of V, S1,...,59,--.,52. Define the minimum-cost assignment with respect 
to the real z-vector s = (81,...,8,) to be the minimum-cost assignment with respect 
to edge costs C;; + fai j)E 55} Sq. If Ay 1s the minimum-cost assignment with respect 
to s, define 
z 
a(s)= DS) ty — DUSel ~ 1) 59. 
(,j)EAR q=1 


Then maxs>0 a(s) = W. 


Theorem 3.1.3 follows from choosing the subtour elimination constraints and the 


outdegree 1 constraints for Br > d. Theorem 3.1.4 follows from picking the subtour 
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elimination constraints plus the additional redundant constraint }>; 21; = n for 
Bz > d, while Theorem 3.1.5 comes from picking the indegree 1 and outdegree 1 
constraints for Bz > d. In each case, the results of Edmonds [7] guarantee that 
Bz > d has integer extreme points. 

Theorem 3.1.5 is of special interest, since some non-constructive approximation 
algorithms for the asymmetric TSP are based on the assignment problem. Several 
researchers have used the assignment problem with no edge weighting as a lower 
bound for the TSP (see [2], §2). A more sophisticated approach was developed by 
Balas and Christofides [1]. They consider the minimum-cost assignment A; subject 


to a certain set of weights w;. They find 


L(w) = min{ > (ei; — yy weai;) + BS wag} 


(i,j)EAr t€T teT 


where T is a set of linear combinations of the subtour elimination constraints and 


node-degree constraints expressed in the generic form 


t t 
a 552i; > do. 
1<i,j<n 


Although the best bound can be obtained by finding max,,>9 L(w), for computational 
reasons Balas and Christofides consider max,ew L(w), where W is a particular sub- 
set of the non-negative w. The next theorem shows that their heuristic is dominated 


by the Held-Karp heuristic. 


Theorem 3.1.6 The value produced by the Balas-Christofides heuristic is no greater 
than that of the Held-Karp heuristic. 


Proof: As with Theorem 3.1.5, we apply Geoffrion’s theorem by letting Bx > d 
correspond to the constraints i eS 1 tH 1a Wand) ty Sly 7 = Tage, 
and let Az > 6 correspond to the constraints Digizen Qi Li; > aj,t € T. Then 


cz + A(b— Ar) = L(A). By Edmonds’ theorem, Bz > d has integer extreme points, 


sO MaXw>0o E(w) has the same value as the optimal value to the linear program 
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minimize S- Ceti (3.5) 
1<iggn 
subject to: eer =F 1l<i<n, 
j 
tj = 1 1<j<n, 
1 
a aici; > ab teT 
wyetypo 0 ’ 
1<ij<n 
zi; = 0. 


Since the equations )ii<j j<n ai ri; > a} are simply linear combinations of the 
subtour elimination constraints and the node degree constraints, the linear program 
above (3.5) must be achieving the same optimal value as the asymmetric Subtour 
LP (3.1) without the redundant constraints. Therefore, max,>0 L(w) = W, so that 
max,ew L(w) < W. 

Despite this theorem, Smith [34] finds empirically that in the asymmetric case, 
assignment problem heuristics produce better lower bounds than the subgradient op- 
timization version of the Held-Karp heuristic which uses weighted 1-arborescences, 
even when the assignment problems are unweighted. This suggests that this com- 
putational method for the Held-Karp heuristic in the asymmetric case needs some 


improvement. 


3.2 Monotonicity of Solutions 


In the asymmetric case with triangle inequality, the best known tour-constructing 
algorithm produces a tour of cost at most [logn]OPT. We will show that the Held- 
Karp heuristic for the same set of problems does at least as well, with a guarantee of 
Y= Tent To prove this, we first need to show a result analagous to the monotonic- 
ity result given for the symmetric case in Section 2.2. The proof of this result is very 
similar to the proof of Theorem 2.2.4, but we include it here for completeness. We 
will use the fact that the asymmetric Subtour LP (3.1) has the same value as opti- 
mally weighted asymmetric 1-trees (via Theorem 3.1.4). Recall that a minimum-cost 


asymmetric 1-tree with respect to a and @ is the minimum-cost asymmetric 1-tree 
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with respect to edge costs ¢;; = cj; + a; + 6;. Then, when Tj, is the minimum-cost 


asymmetric 1-tree with respect to a, 3, 


Th 
wla,B)= >> G;- d(ai + Bi), 
(i,j) ET i=l 
and by our theorem, max,,g w(a, 8) = W. 

First, we establish some notational conventions. Oj,,J;, will be the outdegree 
and indegree, respectively, of the ith node in the kth asymmetric 1-tree. Then 
ai, = Oj, —1 and 6; = Ij, —1. Set c, = Vasere c;;. The adjusted cost of a tree 
T;, will be 

n Tr 
cet > (iain t+ Bide) = SY ty — Do(ai + fi). 
i=1 (i,7)ET, i=1 
We will let {ij} stand for some orientation of the edge (i,j) so that a sentence like 
“removing {ij} lowers the cost by c,;;;” means either “removing (7, 7) lowers the cost 
by cij” or “removing (j,2) lowers the cost by ¢;;”. 

As in the symmetric case, we can express finding the optimal asymmetric 1-tree 

as a linear program. If we let 7;,...,7; be the enumeration of all asymmetric 1-trees, 


then finding max,,g w(a,f) can be expressed as 


maximize w 


subject to: wo < ch+ Ly (aia + Bibix), Vk = 1,...,¢. (36) 
The dual of this LP is 
minimize yee CRUE 
subject to: So. aye =: Oy 2S Lanny (3.7) 
ee OiRYR = 0, 2=1,...,0, 
Ye 2 0 


The dual finds the convex combination of asymmetric 1-trees such that each node 
has average indegree 1 and average outdegree 1. 

Recall the definition of monotonicity. If W is the cost of the asymmetric Subtour 
LP, O CV, and Wo is the cost of the asymmetric Subtour LP on node set O, then 
the asymmetric Subtour LP is monotone if for any TSP instance and any O C V, 


Wo < W. As before, we will let W denote the value of the asymmetric Subtour 
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LP, and let Wi,_1) denote the value of the asymmetric Subtour LP on the node set 
{1,...,n—1}. Assuming W,,_1 > W will lead to a contradiction. 
Let T = T,, @ = (@,...,@n,_1), and B = (fy,...,8,_1) be the optimal 1-tree 


and the optimal Lagrangean multipliers for [n — 1], respectively, so that 


n—-1 


Win-1) = ck + 9 (Giain + B; dix). (3.8) 


t=1 
We first show that T and (@, 8) can be picked such that the two edges adjacent 


to node 1 have the same reduced cost. 


Lemma 3.2.1 There exist Lagrangean multipliers (@, 3) for [n —1] for an optimally 
weighted 1-tree T such that if {1,2}, {1,z} € T, then Cz} = Ff12}- 


Suppose that {1,2}, {1,2} € T, and t4,; < t,}. This implies that {1,2} must 
be the single cheapest edge adjacent to 1, so all optimal 1-trees with respect to the 
Lagrangrean multipliers (@,) must include {1,2}. 

Consider the dual linear program (3.7) that finds the minimum-cost convex com- 
bination of asymmetric 1-trees. By complementary slackness, each tree T; for which 
y; # 0 in the optimal dual solution is a minimum-cost 1-tree with respect to (a, f) 
in the primal. As noted above, {1,2} must be in each of these trees. Since x will 
have at least degree two for each tree (as it is in a cycle), it must have exactly degree 
two for each tree in the dual solution. In fact, it must have indegree exactly 1 and 
outdegree exactly 1. 

Pick one such tree T;. Since x has indegree 1 and outdegree 1, increasing either 
Gz or Z,, will not change the adjusted cost of T; from the optimum value, Win—-1- AS 
in the symmetric case, this does not affect the optimality of the spanning tree of T;, 
on 2,...,n—1. If node z is also adjacent to node 1, we increase @, (if {1,2} = (2,1), 
B, if {1,2} = (1,2)) by €(12} Cte}. Then {1,z} and {1, z} are still the two cheapest 
edges adjacent to 1, but €4,} = €4,2}. By the arguments above, 7; is a minimum- 
cost l-tree with respect to the modified multipliers (@, 3) such that T;, has adjusted 
cost Wi,_1]. Thus T, and the new (a, 3) are optimal. ml 

We will now assume that W,,_1) > W and show that this leads to a contradiction. 


Let T(an,8n) be the minimum-cost 1-tree on V with respect to (@, 3) for nodes in 
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[n — 1] and ay, 8, for node n. If the adjusted cost of T(an,G,) is greater than or 
equal to Wi,_1) for any an,8n, then by supposition it is greater than W. Thus we 
have found vectors (a, 3) for which the minimum-cost 1-tree on V has adjusted cost 
greater than W, which contradicts the maximality of W. 

Thus, T(a,, Gn) must have adjusted cost less than W,,_1)- We will show that we 
can delete node n from some T(a,,8,) such that the adjusted cost of the resulting 
1-tree is no greater, which contradicts the minimality of T with respect to (a, ). 


Thus the supposition W < W,,_1, must be false. 


Lemma 3.2.2 There erist Qn, By such that n has indegree one and outdegree one in 


T(Qn, Fa) 


Proof: If an, G, are sufficiently large, then the node must have either indegree one, 
outdegree zero OR indegree zero, outdegree one in any minimum-cost 1-tree. Then, 
as in the symmetric case, we can slowly reduce either a, or §, by 6 until n has 
indegree one and outdegree one. 


We can now prove the theorem. 
Theorem 3.2.3 Wi,_1; < W and thus the asymmetric Subtour LP is monotone. 


Proof: Assume, as we have above, that W,_1) > W, and that T = T; and @, # are 
the optimal 1-tree and multipliers for [n — 1]. Let @,,@,, be such that node n has 
indegree one and outdegree one in T(@,, f,,) = Tp, and let w and z be the two nodes 
adjacent to n, with (w,n),(n,z) € T,. If (w,x) and (z,w) are not in T,, then form 
the 1-tree 7, by removing edges (w,n) and (n,z), and adding (w, x). Since an, = 0, 


bap = 0, Gip = Gig, bip = big, and Cur < Cwn + Cnz by the triangle inequality, 


Cq + faa (Gidig + Bibig) S Cp + Qndnp + Bubnp + Diy (Gidip + Bibip) 


nal je 3.9 
< eet DE (Giaiz + Bibix), 32) 


which contradicts the minimality of T(= T;) on [n —1] with respect to the multipliers 
(@, 8). 
Suppose that the edge (w,z) (or (z,w)) is already in T(an, 6,). This means that 


there is a undirected cycle (n, w, x), and since node 1 is in the unique cycle in a 
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1-tree, either w or z must be node 1. Say that w = 1. By the optimality of T(an, Bn), 
{1,2} must be one of the edges adjacent to node 1 in T. By Lemma 3.2.1, there 
exists another edge {1,z} with €4,} = {12}. So we can remove edge {1,z} and add 
{1,z} without affecting the optimality of T(an,8,). {1,2} = {w,z} is no longer in 
the tree, so we can shortcut node n as above. 

This establishes the desired contradiction, so it must be the case that Wry,_y < 
WwW. 

The best-known tour-constructing approximation algorithm has a guarantee of 
a = flogn]OPT and is due to Frieze, Galbiati, and Maffioli [11]. Their algorithm in- 
volves iterating the assignment problem. The assignment problem yields a collection 
of subtours on the nodes. A representative node from each subtour is selected, and 
the process is iterated. When all remaining nodes are in one subtour, the subtours 
represented by the remaining nodes are patched in. Since the number of nodes is 
at least halved on every iteration, at most [logn] iterations are needed. Further- 
more, each assignment problem is a lower bound on the cost of the tour; i.e., if 
A1,---,Anogn] are the costs of the [logn] assignment problems, then A; < OPT 
for 1 <i < [logn]. Also, since the combination of the assignments yields a directed 
Eulerian graph which can be shortcut to a tour, se n| A; > OPT. It follows that 
this method yields a tour no longer than flog n]OPT. 


The cost of each assignment problem can be bounded in terms of W. 


Lemma 3.2.4 Let A; be the cost on an assignment problem on some subset of nodes 
S; CV. Then A; < W. 


Proof. Let = be an optimal solution to the asymmetric Subtour LP on the nodes 
O=5; CV. By the theorem above, Wo < W. By Theorem 3.1.5, for assignments 
on $;, MaXs>9 a(s) = Wo. The minimum-cost assignment on 5; has cost A; = a(0), 
so A; << W. 

Thus 
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Chapter 4 


The 1,2-TSP 


The 1,2-TSP is a special subcase of the symmetric TSP in which either c;; = 1 or 
¢;; = 2 for all 1,7. Notice it follows that the 1,2-TSP obeys the triangle inequality. 
Even with this restriction, the 1,2-TSP is W’P-complete; in fact, it was this version 
of the TSP that was shown to be NP-complete in Karp’s groundbreaking paper on 
the MN P-completeness of certain combinatorial problems [22]. 

The strong limitation on edge costs gives the 1,2-TSP some unusual properties. 
For instance, any tour whatsoever will have cost no more than twice the cost of the 
optimal tour, for the simple reason that a tour will have to cost at least n, but no 
tour can have cost more than 2n. We prove another unusual property of the 1,2-TSP 


below. 


Theorem 4.0.5 Let OPT be the cost of the optimal tour for a 1,2-TSP instance, 
and let BIC be the cost of the minimum-cost biconnected graph. Then OPT = BIC. 


Proof: Since a tour is a biconnected graph, certainly BITC < OPT. To prove 
the opposite direction, we will consider the ear-decomposition of the minimum-cost 
biconnected graph. An ear-decomposition is a partition of the edges of a graph into 
“ears”, or paths in the graph. The paths are either simple paths (no repeated nodes) 
or simple cycles (only the end-nodes of the path are repeated; “interior” nodes are 
not repeated). An ear decomposition is a sequence of ears such that each edge of the 
graph is uniquely contained in some ear, the end-nodes of an ear appear in previous 
ears in the sequence, but interior nodes of an ear are not contained in any previous 


ear. We will use the following theorem. 
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Theorem 4.0.6 (Whitney [38]) An undirected graph is biconnected if and only if 


it has an ear decomposition whose first ear is a cycle. 


Let F,...,£;, be the ear decomposition of the minimum-cost biconnected graph. 
We will show inductively that there is a tour through the nodes of the ears Fj,..., F; 
which cost no more than the edges in Fy,...,£;. Then for 7 = k, we will have a 
tour that costs no more than the costs of the edges in the decomposition; in other 
words, OPT < BIC. The base case is trivial, since Ey is a simple cycle. Suppose 
the inductive hypothesis holds for 7. Let J; be the tour constructed from £},..., Ej. 
If F341 is an edge, the hypothesis holds for 1+ 1 trivially. If F;41 is a cycle, it must 
have one node in common with T;: call it p. Let (p,u) be an edge from T; and let 
(p, f) be an edge from F;41. Then T;41 can be constructed from T; and F;41 by 
removing (p,u) and (p,f), and adding (u,f). By the triangle inequality, T;41 will 
have cost no greater than that of T; plus that of F411. Now suppose that L,41 is 
a path. It meets T; at exactly two nodes: call them p and g. There must be edges 
(p, f) in Fiza (f # q) and (q,w) in T;. We can construct a tour Tj41 from T; and 
Fiz, by deleting (p, f) and (q,u), and adding (u, f). This changes the cost of T; plus 
Ei41 by Cus — Cp¢ — Cqu Which can be at most 2-1-—1=0. HI 

Recall our conjecture at the end of Section 2.2 that the lower bound of the Held- 
Karp heuristic is the same as the lower bound for the minimum-cost biconnected 
graph (namely, 20PT) for the symmetric case with triangle inequality. It might 
seem reasonable to conjecture here that the Held-Karp heuristic displays the same 
sort of behavior, and is close to OPT = BIC, perhaps within an additive constant. 


The theorem below shows that this is not the case. 


Theorem 4.0.7 For all No, there exists an instance of the 1,2-TSP with n nodes, 
n > No, such that the optimal solution to the Subtour LP has cost OPT. 


Proof: We will demonstrate a family of instances J, of the 1,2-TSP such that 
OPT = 10k and the cost of the optimal solution to the Subtour LP is 9k. The 
family of instances is built up recursively from an instance J; shown as a graph in 
Figure 4.1. Instance J; is a known example from the literature. The edges in the 


graph correspond to edges whose cost is 1; edges not present in the graph have cost 
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Figure 4.1: Instance 


2. Instance Ig is constructed by attaching a variant of J, called Jp to nodes a; and 
b; in I;. See Figure 4.2; we add edges in the place of the dotted lines. Instance 3 is 
constructed by attaching Ip to a2 and 62 of Ig, and so forth. 

First, we will show by induction that the cost of the optimum tour for instance J, 
is 10k. Figure 4.3 shows a tour of length 10 for 4. A tour for J,41 can be constructed 
from a tour for I, by removing (a,,b,) and traversing Jo in a manner similar to the 
tour of fh. 

Now we need to show that there is no tour of J, that has cost less than 10k. The 
base case is simple: by exhaustive search, /; has no Hamiltonian cycle. Suppose that 
the inductive hypothesis holds for Jj, but not for J,41. We will show that this forces a 
contradiction. All tours of 1,2-TSP instances have cost equal to the number of nodes 
in the graph plus the number of cost-two edges in the tour. If the hypothesis doesn’t 
hold for J,41, then there must be fewer than k + 1 cost-two edges in the optimum 
tour for [y41. Divide the cost-two edges of the tour into three sets: S;4, 50,0, and 
Szo- Since J,41 is constructed from an J, instance and an Jo instance, S;,, will be 
the set of cost-two edges whose endpoints are both in the J; section of I,41, Soo will 
be the set of cost-two edges whose endpoints are both in the Jo section, and 5,9 will 
be the remaining cost-two edges. Clearly |S, %| + |So,o| + |Sé,0] < k. 


Suppose |S;.9/ = 0. Then the tour must enter and leave the Jp section through 
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re) 
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Figure 4.2: Instance Ig = Jy + Ip 


Figure 4.3: Optimum Tour of 4 
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edges (a,,c) and (by, @441). Any Hamiltonian path in Jp from ¢ to ay41 must use a 
cost-two edge. Thus there is a Hamiltonian path entirely in J, from a, to bg with 
fewer than k cost-two edges. But then we could construct a tour of J; with cost less 
than 9k + k = 10k by adding edge (a,,5,) to the path, contradicting the hypothesis 
that the optimum tour of J; has cost 10k. 

Now suppose |.S;9| > 0. Consider the tour of J, obtained by shortcutting all 
visits to the Jp section. For instance, if the tour enters the Ip section via a cost-two 
edge (ux, uo) and leaves it via a cost-two edge (vo, v,), delete the path from u, to 
v, and add edge (uz, v;). Call this a “type I” shortcut, and note that it removes at 
least two cost-two edges from the graph and adds at most one. If the tour enters the 
Io section through a cost-two edge (ux, uo) and leaves it via (c,ax%) (or (a441, 5%)), 
remove the path from uz to a, and add edge (uz, a,) (or (uz, b,)). This “type II” 
shortcut removes at least one cost-two edge and adds at most one. If we perform 
any type I shortcuts, then our resulting tour of J, will have fewer than k cost-two 
edges, which contradicts the hypothesis. We can have at most two type II shortcuts, 
since the tour cannot pass through a, and by; more than one time each. Suppose the 
two type II shortcuts add two cost-two edges (ux, a,) and (vz, b,). We remove these 
two edges, and construct a new tour by adding (ux, v%) and (a,,d,). Then we have 
removed two cost-two edges, and only replaced one, so the new tour of J; uses fewer 
than k cost-two edges, a contradiction. 

Finally, suppose we have one type II and no type I shortcuts. If we enter via 
(u;,, Uo) leave via (c,a,), notice that there is no Hamiltonian path from any uo in Ip 
through all nodes in [p to c. Thus the path from up to c must use at least one cost- 
two edge, so performing this type II shortcut removes two cost-two edges and adds 
one, which is again a contradiction. If we enter via (uz, ug) and leave via (441, bx), 
then there must be a cost-two edge in the tour adjacent to a, (since neither (ag, bj) 
nor (a@%,¢c) can be in the tour). Call this edge (ax,v). If (ax,v) = (ux, uo), the 
shortcutting removes a cost-two edge and adds a cost-one edge (namely, (a, 0, )). If 
not, perform the shortcut. If it adds a cost-two edge (b,, ux), then construct a new 
tour by removing (b;,,u,) and (a,,v) and adding (a,,b,) and (uz, v). In either case, 
we get a tour of J, with fewer than k cost-two edges, a contradiction. 


Now we must show a Subtour LP solution for i, with cost 9k. Certainly any 
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Figure 4.4: Feasible Solution to I, 


solution to the Subtour LP for J; must have cost at least 9k, since for any solution 
ics Zig = 2 = Ok, and c;; > 1 for all 2,7. Consider a generalization of the solution 
to Iz shown in Figure 4.4. It is not hard to check that this is a feasible solution of 
cost 9k (the subtour elimination constraints can be checked using the edge-shrinking 
heuristic of Crowder and Padberg. See [28], §2.1). 

The best known guarantee on the Held-Karp heuristic for the 1,2-TSP is the 
a 2 bound of the symmetric case with triangle inequality. The best known tour- 
constructing heuristic for the 1,2-TSP is due to Papadimitriou and Yannakakis [30]. 
Their heuristic guarantees a tour with length no longer LOPT. Since $ < 3. it is 
an interesting open question as to whether the Held-Karp heuristic for the 1,2-TSP 


is as good as Papadimitriou and Yannakakis’s heuristic. 


Chapter 5 


Conclusions and Open 
Problems 


Through the course of this thesis, we have seen that solutions produced by the Held- 
Karp heuristic have deep connections to matroids and biconnected graphs, and also 
have nice structural properties, including planarity and monotonicity. In some cases 
we have been able to exploit this structure to find lower bounds on the worst-case 
performance of the heuristic. Since we can find no instances on which the heuristic 
does as badly as our bounds, we strongly suspect that these bounds can be improved. 
What are these better bounds? What additional structural properties will we need 
to prove these bounds? 

One of the initial motivations for exploring the structure of Held-Karp solutions 
was the heuristic’s extremely good performance “on average”. However, we have 
confined ourselves to considering the worst-case performance of the heuristic. Can 
anything be said about the “average” case performance of the heuristic? Goemans 
and Bertsimas [14] give a probabilistic analysis of the heuristic for instances drawn 
from #4 under the Euclidean metric. Can more be done along these lines? 

We noted in the introduction that there are no known practical polynomial-time 
algorithms for the Held-Karp heuristic. We also pointed out in Chapter 3 that 
although in theory the Held-Karp bound for the asymmetric case should be better 
than certain assignment-problem based bounds, in practice some researchers found 
the opposite to be true. This shortfall between theory and practice may be due to use 


of the subgradient optimization algorithm, which is not guaranteed to converge to the 
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FSIONS AND OPEN PROBLEMS 


optimal value. Further work on the Held-Karp heuristic chould include an attempt to 
find a practical algorithm. We think that the multiple defiaitions of the Held-Karp 
heuristic in Section 3.1 in terms of weighted l-arhessscences, 1-natiarborescences, 
asymmetric 1-trees, and assignment problems may be belpfel in finding such an 
algorithm. 
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